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The theoretical capabilities of a "polyphase" coding -modulation scheme 
with additive white Gaussian noise are studied. The channel capacity of this 
system is found and the error exponent estimated. Bounds are also found, on 
Ro(pmax), the maximum (asymptotic) rate for which polyphase codes can 
be found with maximum correlation between code words p max . 

I. DEFINITIONS AND PRELIMINARIES 

We shall consider the following ("polyphase") coding-modulation 
system (schematized in Fig. 1): 

Every T seconds the message source emits one of M equally likely 
messages. The information rate is R = \/T In M nats per second. 
Corresponding to the tth message (i = 1, 2, ■ • ■ , M) the coder emits an 
w-vector x, = (xa , x« , • • • , Xi„), where 

-7T g .r„ g tt, k = 1,2, ••• ,n, (1) 

and where the integer n will be specified later. The time interval [0, T\, 
during which this information must be transmitted, is divided into n 
equal subintervals of length T/n. During the fcth of these subintervals, 
the modulated signal is 

*(f) - V2S cos (aj + Xik), U - 1) - g t < — -, 

n n ( 2 ) 

k = 1,2, • • • , n. 

Thus, we have employed phase modulation with carrier frequency co c 
radians per second and average power S. 

We assume that the noise is additive, white, and Gaussian with one- 
sided spectral density N„ . The receiver must examine the received 
signal y(t), the sum of s,(/) and the noise, and determine which of the 
Jl/ messages was actually transmitted. It is well known that (since all 
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Fig. 1 — Polyphase coding-modulation system. 

signals are equally likely to be transmitted, and have equal energy ST) 
the optimal decoder (which minimizes the average error probability) 
selects that signal s,-(/) which maximizes p, , the (normalized) correla- 
tion between s,(/) and y(t): 



1 f T 



(3) 



Let us remark at this point that the correct operation of the decoder 
depends on its exact knowledge of the possible transmitted signals, so 
that in particular all delays and distortions to which the signals are 
subjected in transmission must be known exactly by the receiver. This 
is a so-called "coherent" receiver. 

We let P ei equal the probability that the decoder output is incorrect 
given that message i was transmitted, so that the average error prob- 
ability is 



1 S 

= — Y p 

i=l 



(4) 



Now, the same channel is to be used by a number of users simultane- 
ously, each at a different carrier frequency. Let W cycles per second be 
the separation of carrier frequencies between adjacent users (W will be 
taken as the "bandwidth"). Then the carrier frequency for the ath user 
(a an integer) is o> c = a2wW radians per second. Further, we shall set 
n = WT (let us say that T is such that WT is an integer), where n is 
the number of subintervals defined previously. With w c and n so chosen 
and the signals constructed as in (2), it is easy to show that the signals 
of the ath and /3th (a 9^ /3) users are orthogonal on the interval [0, T\. 
Hence, the presence of the signal due to the /3th user does not affect the 
correlator in the decoder of the ath user. 

Let us say that the transmission rate R and the bandwidth W are 
held fixed, and let T, the duration of the signals (hence n = WT), become 
large. Every T seconds the message source will produce one of M = e RT 
equally likely messages to which the coder must assign an n-vector. The 
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channel capacity C is the maximum rate for which we may make P e 
vanishing small for T sufficiently large. Formally, for any R < C and 
e > 0, there is a T sufficiently large so that the transmitter may transmit 
one of M = e messages with P e < e. (This will necessitate a set of 
M = e w -vectors stored in the coder. ) The channel capacity C of this 
coding-modulation scheme is found in Section III. 

Let us consider again the decoding scheme. Making use of the fact 
that the p t - of (3 ) are normally distributed random variables, it is possible 
to write an expression for the error probability P e * which depends only 
on the signal energy to noise ratio ST/N and the matrix of normalized 
inner products among signals 

1 f T 

Pa = gf J o 8i(t)8iU)dt, i,j = 1,2, • • • ,M. (5) 

From (2) we obtain 

Pa = - 2 cos (x ik - x jk ), i,j = 1,2, • • • , n. (6) 

n fc=i 

It is knownf that the error probability P, (as given in (4) ) using the 
optimal decoder may be bounded by 

P e ^ /(max pa), 

where f(x) is an increasing function of x. Accordingly, a reasonable 
procedure for designing good coding systems would be to try to make 
Pmax = max pa as small as possible. Alternately we pose the problem as 

follows : 

With W, T, p max held fixed, what is the largest rate for ,_. 
which we can design codes with parameters W, T, p max ? 

Let us observe that from (6) 

1 n 

Pij =1 £ [1 — COS (x ik — Xjk)] 

n k=i 

(8) 

= 1 - i E 2 sin 2 (Xik - Xik) = 1 - ^''^ 
n k 2 2n 



*Ref. 1, (2.11). 

t Ref. 1, (4.7) and Ref. 2, p. 498. 
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where the "distance" d(x,- , x,-) is denned by 

d\x< , x y ) = t [2 sin (xa ^ Xik) J (9) 

Thus, a code with maximum p,-,- = p mta , has minimum d 2 (x,- , X/)/2n = 
(1 — Pmax)- In the light of the above, we shall reformulate the problem 
as follows : 

Let Cfc„ be the space of real n-vectors x = (xi , x 2 , • • • , x„ ) (where 
n = WT) which satisfy 

— w ^ x k ^ + r, k = 1,2, ■-■ ,n. (10) 

Let x = (.ri , • • • , x„) and y = (y x , • • ■ , y„) ed n , and define the 
distance between x and y as 

<*(z,y)=[g(2sin^^) ! J. (11) 

It will be shown in Section IV that d(x,y) is, in fact, a metric. A code 
is a set of M members of &„ , {x,- = (xa , x i2 , ••• , x in )}i=i. The 
transmission rate is R = 1/n In M nats per symbol. The transmission 
rate in nats per second is R = (1/T) In M = "PF^. We will define M (w,«0 
as the maximum number of code vectors in an n-dimensional code with 
minimum distance between pairs of code words d. Then R(n,d) = (1/n) 
In M(n,d), and R(n,d) = (1/T) In M(n,d) are the corresponding trans- 
mission rates. A problem equivalent to that of (7) is the determination 
of R(n,d). In Section IV we shall let n (and hence T) become large 
while the ratio /3 = d' 2 /2n is held fixed (corresponding to a fixed p max ) 
and estimate R(@) = lim R(n, V2w/3) by upper and lower bounds. 

n-»oo 

Since /3 = 1 — p„.ax , R(l — p,„ ax ) is the (asymptotic) maximum rate 
for polyphase coding with max pn = p max . 

II. SUMMARY AND DISCUSSION OF RESULTS 

The channel capacity is shown in Section III to be 

C= T7[-^/(p)ln^dp + ln2^], (12) 

where 

A = 8/N„W (12a) 

is the signal-to-noise ratio, and 

/ f( P ) = 2pAe- M1+p2) Io(2 P A), (12b) 
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and I v (x) is the modified Bessel function of vth order. Another formula 
for C is (93). Approximate formulas for C for large and small values of 
the signal-to-noise ratio A are obtained in Appendix A. For large values 
of A, 



W 



(?') 



+ ei(A), 



(13) 



where e 1 (A ) — » as A 



> 00 . For values of A close to zero 
C = W[A +0(A 2 )]. 



(14) 



The capacity C is plotted versus the signal-to-noise ratio A in Fig. 2. 
Estimates of the optimal achievable error probability are obtained in 
Appendix D. 

The upper and lower bounds on R((3) are expressed in terms of the 
function C (£) which is defined as follows. Let £ be chosen 

< * SS 1, 

then define X(£) as the (unique) solution of 
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Fig. 2 — The channel capacity C va the signal-to-noise ratio A = S/N W — 
(12) (solid line). (Curves A and B are the approximations to the capacity C for 
large and small values of the signal-to-noise ratio A, respectively — (13) and 
(14). Curve C is W In (1 + A), the capacity of a channel with bandwidth W and 
no restriction on the modulating scheme. 
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, = [\ Ii(2\(£)) 1 
* L /o(2X(€))J' 



(15) 



The existence (and uniqueness) of the solution to (15) is established in 
Appendix B. A graph of A(£) versus £ is shown in Fig. 3. The function 
Co(£) is then denned as 



Cttt) = -lnJ.(XG)) + (1 - €)Xtt). 



(16) 



A graph of C (£) versus. £ is shown in Fig. 4. Our bounds on B(/3), 
which are obtained in Section IV (and plotted in Fig. 5) are 

CoOS) ^ &(fi) ^ C o (y 2 0), (17) 

where C (£) is denned in (1) and 



7 2 =i(i- vr^)- 



(18) 



The lower bound is of the same type as the Gilbert bound for binary 
coding, and the upper bound makes use of the Blichfeldt density method. 
Let us remark that the upper and lower bounds of (14) agree when 
j8 = 1, yielding R(fi) = for ^ 1. When is small it is shown in 
Appendix E that 



| In -L + £2 (/3) = £(0) = * In 4s + *</*>> 

7re0 ^e/3 



(19) 
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Fig. 3 — The function A(?) vs £ — (15). 
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Fig. 4 — The function C (£) vs £— (16). 

where d , Ei — > as /3 — * 0. Thus, for sufficiently small /3, # (fi) is within 
£ In 2 of £ In (2/re/3). 

In terms of the modulation scheme discussed in Section I it is more 
revealing to rewrite inequalities (17) in terms of p max the maximum 
correlation between pairs of signals. Let Ro(p max , W, T) = Ro(p m *x , T) 
be the maximum rate (in nats per second) attainable for the polyphase 




Fig. 5 — The upper and lower bounds R (Ji) vs /3 and p max — 1=0 — (17). 
R (/3) lies in the shaded region. 
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modulation scheme of Section I with parameters p max , W, and T. Let 
-B (Pm»%) = limit R (pm*x, T). In the light of comment following (9), 

T-.00 

Ro(pm*x) = R[(l - Pm«)]. The upper and lower bounds on RoQhaax) 
are plotted versus pmax in Fig. 5. 

Appendix F contains a comparison of the capabilities of this polyphase 
system and another important modulation system. 

III. CHANNEL CAPACITY 

The signals Si(t), i = 1,2, •■-, M, are of the form 



7> hT 

8i(t) = V2S COS (a2 V Wt + X*), (fc - 1) - £ t < —- , 

7b 7b 



(20a) 



k = 1,2, • • • , n, 
where n = WT and 

-T ^ x ik ^ t, k = 1, 2, • • • , n. (20b) 

Alternately, we may write 

Si(t) = x ik ll) cos a2irWt + x ik {2) sin a2irWt, 

T IcT (21a) 

(fc - 1) - ^ * <— , fc= 1,2, ••• ,n, 
n n 



where 



Xik 



= V2S cos z,- fc , x ik (2) = V2S sin x ik . (21b) 



The noise function z(t) is a sample from a white Gaussian noise 
process with one sided spectral density N (so that the covariance is 
r( t ) = (N /2)8(t)). The received signal \sy (t) = s,(<) + z(t), where 
Si(t) is one of the M signals. The optimal decoder computes 



1 f T 
i=of] Si(t)y(t)dt, 



ST 

and decodes y(t) as that s,(<) with largest p< . If y(t) is the received 
signal, let y*(t) be 

y *(t) = y k (1) cos a27rIF« + y™ sin a2n-TP«, 

T IcT (22a) 

(fc-l)i^K-, fc= 1,2, •■■ ,n, 
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where 



and 



[kT/n 

y k w = 2W / y(t) cosa2TrWtdt, (22b) 

J (k-l)(T/n) 



fkT/n 
.. < 2 > 

Vk 



rkT/n 

= 2W / y(t) sin c&rWtdL (22c) 

J (k-l)(T/n) 

We may think of y*(t) as the projection of y(t) onto the space of allow- 
able signals. It follows by direct computation that 

^/ o Si (t)y*(t)dt, 

the correlation of y*(t) and the ith. signal s»(i) , equals p, . Thus, without 
loss of generality, we may consider the received signal to be y (t). From 
(21) and (22), it suffices to consider the noise to be 

z*(t) = y*(t) - 8i(t) = z k a) cos oQrWt + z k m sin a2rWt 

T IcT (23a) 

(k- 1)- £ t < — , k= 1,2, ••• ,n, 
n n 



(1) _ „. (1) „ (» nn A „ < 2) — „, (2) ™ (2) 

and Zk = 2A- — z*t , 



(23b) 



where 

*A- (1) = ///.•'"' - X ik 

k — 1, 2, • • • , n. 
From (23b), (22b), (21b), and (20a) we may write 

/kT/n 
(y(t) - 8i(t)) cos c&icWtdt 
y k-\)(Tln) 

rkT/n 

= W / z(t) cos c&rWt dt, k = 1,2, ■ • • , n 

J (k- l)(T/n) 

so that Zit is a normally distributed random variable with mean zero 
and variance 

rkT/n 



:24: 



rkT 

E(z k (1) ') = W 1 / 
J(k- 

rk'i n 

• / cos c&wWt (cos a2wWT)z(t)z( T ) dt dr, 

J(k-l)(T/n) 



*zr ^ 



where the over-bar denotes expectation. Since z(t)z(r) = R(t — t) = 
(N /2)8(t - t), the variance of z k w is N W. Similarly for z k w . 
Further, E{z k w z k w ) = 0, and 



E(z kl w ,z k2 u ') = (i,j = 1, 2) if h * k 2 . 
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Thus, these random variables are independent. 

We conclude from the above that our channel is equivalent to the 
following lime-discrete memoryless channel. Every T/n = l/W seconds, 
the channel input is a real number Xs[— ir,ir]. The output is a pair of 
numbers Y\ and F 2 given by 

Fx = X t + Z t , F 2 = X* + Z 2 (26a) 

where 

Xi = V2S cos X, X 2 = V2S sin X, (26b) 

and Zi , Z 2 are independent normally distributed random variables with 
mean zero and variance N = NoW. Consequently, known results for 
determining capacity may be used. 

If an input probability distribution is specified, the mutual informa- 
tion of the input and the output is 

I{Y,,Y 2 ;X) = H{Y,,Y i ) - H(Y l} Y 2 \X), (27) 

where H(Y X , F 2 ) is the joint uncertainty of Fi and F 2 and 

H(Yi, Y 2 \X) 

is the conditional uncertainty of Fi , F 2 given X. The channel capacity 
C, in nats per second is 

C = W[iaaxI(Y lt F 2 ; X)], (28) 

where the maximization is performed over all possible input distribu- 
tions. We proceed to find C. 

Say X = x, and let x x = -y/2S cos x, .r 2 = \/2S sin x, then 

H(Y X ,Y 2 \X = x) 

(29a) 
• / dyidyigiyi — Xi, y» — x 2 ) In g{yi — xi , y 2 — x 2 ), 



where 



g(zi , «,) = 2^y ex P t- (^ + 22 2 )/2AT] (29b) 



is the joint probability density of Z x , Z 2 . After changing the variables 
of integration and integrating (29a), we obtain, 

H (Fi , Y t | X - x) = In 2ireN, (30) 
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independent of x. Thus, 

H(Y 1 Y i \X) = ]n2*eN, (31) 

independent of the input distribution. 

Thus, to find C, we must maximize H(Yi, Y2). Say po(x) is the 
probability density of the input X, and puiyi , 2/2) the resulting joint 
probability density of the output pair (Fi , F 2 ). If we characterize the 
output pair by polar coordinates ((R, <f>), then the corresponding den- 
sity for (R, <i> is 

fn(r,<p) = rp 12 (r cos <p,r sin <p), r ^ 0, —r ^ <p ^ r, (32) 

where r is the Jacobian of the transformation. Hence, 



(33) 



H(YiY 2 ) = - / / pn(yi,y2)\npn(yi,y2)dyidy 2 

= — I I pn(r cos <p, r sin <p) 
•In [pnir cos <p, r sin <p)]r dr d<p 

= - ffto) In ^^>dr^ 
•'0 J-t r 

= — I / fn(r,<p) hi fn(r,<p)dr d<p 
+ I / fn(r,(p) In r dr d^ 

•'0 ''-T 

= ff((R,*) + / /i(r) In rdr, 

where ff((R, <£>) is the joint uncertainty of (R, $, and/i(r) is the marginal 
density of (R. Now 

tf((R,<p) ^ H((R) + #(*), (34) 

(where i/((R), //($) are the uncertainties of (R, <p, respectively) with 
equality if and only if (R, <i> are independent, and 

H($) £ In 2*-, (35) 

with equality if and only if $ is uniformly distributed on the interval 
[-tt,t]. Hence, from (33), (34), and (35), 

H(Yi , Y t ) ^ H((R) + In 2tt + f /i(r) In r dr. (36) 

•'0 
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We shall now find /i(r), the density of fll, and show that it is inde- 
pendent of the input density po (x). To begin with, let us say that X = x. 
Then the joint density of (Fi , F 2 ), given that X = x is 

pia(yi,Vi\X = x) 

(37) 
= _L exp {-[( yi - V2S cos .x-) 2 + (2/2 - V2S sin x) 2 ]/2N). 

2ttN 

The joint density of Fi , F 2 or the corresponding joint density of R, $ 
is obtained from (37) by averaging over x: 

fn(r,<p) = rpn(r cos <p, r sin <p) 

= r I p (x)pn(r cos <p, r sin <p | X = x)dx 

= r L Mx)dx ^N 

•exp | - 9^ b" cos ^ - \/2S cos xf , gg v 

-f (r sin ¥? — \/2S sin a;) 2 ] 

•exp f-^Tr — cos (x — (p) J dx. 
Now, the marginal density for R is obtained by integrating <p out of (38) 

Mr) = I M(r,<p)d<p 

(39) 

= 2.n L^L dxv » {x) exp \ — n — ;• 

Interchanging the order of integration, we get 
/i(r) = — 2~-\r — i. P ^^ i. * exp jv" cos ~ r 



re - ( ,. +M ,/ 2 * /V2^-\ 
tf /o V^W ' 



x) 

(40) 
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independent of po(x).* We conclude from (40) and (36) that 

lax H( Yi , Y t ) £ - [ fi(r) ln^ dr + In 2tt, (41 

o(*) J o r 



max 

V 



where /i(r) is given by (40). 

Let us now say that the input distribution is po(x) = l/2ir. Then 
from (38) 

Mra) =/!(r)i (42) 



so that (R, <P are independent with the marginal density of <t>, }i{<p) = 
l/2x. Thus, in this case, the equalities in (34) and (35) and hence in 
(36) hold yielding 

H(Y 1 , Yt) = - f°fi(r) ln"^ dr + In (2*), (43) 

Jo r 

so that (41) is satisfied with equality. From (28), (30), (41), and (43), 
the channel capacity C is given by 

<L = - f /,(,-) ln£^ dr - In eN. (44) 

W Jo r 

If we set p = r/V2S and A = S/N = S/N„W, the "signal-to-noise 
ratio", we obtain 

g= - f/( p ) \J-^1 dp + In ^ , (45a) 

Tv Jo p e 

where 

/(p) = 2.4p e - 1(p2+1) / (2Ap). (45b) 

IV. BOUNDS ON R((3) 

4.1 Upper Bound on R ((3) 

We need the following two lemmas: 



* We shall make frequent use of the formula 

1 f T 
/<,(*) = - / e"°"d8, 

2.TT J 

which can be found in Ref. 4, p. 79. 
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Lemma 1 : Let gi , g 2 , • • • • , g P be real numbers. Then 

tg k 2 ^~ (2<7*) 2 . (46) 

Proof: From the Schwarz inequality 

(t 1-»Y g (± A (± gA = V t Q*\ (47) 

V=i / V=i / V=i / fc-i 

Lemma 2: Ijet (x,},=i m be a set of m n-veciors from Ct„ with minimum 
distance d between pairs of vectors. The distance is given by (11). Let y be 
an arbitrary vector in Ct„ , and denote by rf, the distance d(x,- , y). Then 

(£,-) - 4m (Z^) + 2(m)(m - 1) - ^ 0. (48) 

\,-=i nj \,=i n) n 

Proof: Let us define a mapping of Q„ into E 2n , Euclidean 2n-space, as 
follows. If x = (.Ti , x 2 , • • • , x H ) e «„ , then the corresponding 2n-vector 
is x' = (ui , Vi, u*, V* , • • - , u n , v„ ) where 

u* = cos Xk , v k = sin x k , k = 1,2, • ■ • ,n. (49) 

Then letting Xi , x 2 £ a„ , and letting x/ = (u n , Va , Uu, v n , • • • , 
Win , Win) and x 2 ' = {u 2 \ , V21 , U22 , V22 , • • • , t*2n , v 2n ) be the corresponding 
members of Ei n , the distance between Xi and x 2 is 

d 2 (x! , x 2 ) = 2 2 su 
*=i L 



. (zi* — 2^) 
sin s 










n 






(50) 




(Wit - 


- W2A:) 2 + (Vile ~ 


- Vikf). 





To see this we need only observe that if the a?u , x» , k = 1, 2, • • • , n 
are considered as arc lengths on a unit circle with center at the origin, 
then (uu , v ik ) and (uik , v 2k ) are the Cartesian coordinates of Xm , and 
x 2k , respectively, (see Fig. 6). The quantity 2 sin [(x lk — x 2k )/2] is then 
the Euclidean distance between (u lk , v ik ) and (u 2k , v 2k ). Hence, d(\\ ,x 2 ) 
is the Euclidean distance between x/ and x 2 '. This also provides a justi- 
fication for calling d(\,y) a metric. We are now in a position to prove 
the lemma. 

Without loss of generality we may take y = (0, 0, • • • , 0) so that 
y' = (1, 0, 1, 0, • • • , 1, 0). Let x/ = (un , Vn , u a ,v i2 , ■■■ , u in , v,„) 
then 

d? = d\x i>7 ) = E{(l-w,*) 2 W}. 
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[(u 1k -u 2k )* + { v lk -v 2k rf 2 <^«v.k] 



Fig. G — Proof of Lemma 2. 



Since d(x<, X,) ^ r/, 



m 



. rf 2 ^ £ <?(*< , x>) = EE [(«« - ujkY + (»« - v Jk ) ) 

2>l i<i i<i k-1 



= 2 < m 2 "» — ( S Wit J 

m / m \ 2 

+ m S *»' — ( 2 »«) 

- EWE(i-«,) ! ) 

= m £ 2 { (! — m«) 2 + v ik 2 \ 



(51) 
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- E (e (i - «•))" 

-?(?4 

^ m E d 2 - E (E (1 " M*))'. 

From Lemma 1, (51) becomes 

0) d 2 ^ m E rf. 2 - - (E E (1 - «•))' (52) 

Now, since u ik 2 + t>« = 1> we have 

ttf = E {(1 - ««) 2 + »« ) = E {1 - 2«« + u ik 2 + y* 8 } 

(53) 

= 2 Ed - ^1 

Substituting (53) into (52) yields 

&)* *«?*'- a (S tf )'- (54) 

The lemma follows on multiplying both sides of (54) by 4/n. 

Derivation of the Bound: 

If z £ (J„ let us define the "sphere" S(z,p) as 

£(z,p) = {x f a n : d(x,z) < p}. (55) 

Since the distance d defined on Ct„ is a metric, it follows that if a code 
{x;},=i w has minimum distance (as defined by d), then the spheres 
S(Xi , d/2) are disjoint. 

Consider the maximum size w-dimensional code with minimum dis- 
tance d and M(n,d) code words {x,},=i M . Consider the spheres S(x,- , yd) 
about each code word, where 

1 = - (1 - VT^P) (56a) 

= d 2 /2n. (56b) 

Note that since y > % (0^/3^1),* these spheres are not necessarily 

* This follows immediately when we write y 1 = 1/1 + (1 - 0) m , so that y in- 
creases from 1/V2 to 1 as /3 increases from to 1. 
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disjoint. To each point in the sphere at distance r from the center assign 
a density a(r) = y 2 d 2 — r 2 . Then the "mass" of each sphere is 

n= f (yd 2 - r 2 )dV, (57) 

J r<yd 

where the integration in (57 ) is performed with respect to the Euclidean 
measure, assigned to &„ in the obvious way. 

In general, a vector y e &„ will belong to the spheres about m code 
words say x x , X2 , • • • , x m . We assign to y, a density equal to the sum 
of the densities contributed by each sphere, i.e., 

m m 

(T y = ^2 a-(di) = ?ny 2 d 2 — ^2 d 2 , (58) 

where d> = rf(y,x,-). If y belongs to no sphere <r y = 0. Thus, we have 

mass of Ok = / tr^dV = M {n,d) •/*. (59) 

We will bound M (n,d) by finding an upper bound on the mass of G„ . 
Letting s = s y = a y /n, (58) becomes 

TAl = mrV 2 _o JL= , _ (6Q) 

n n n 

where /3 = <l 2 /2n. Substituting (GO) into (48) we get 

(2m 7 2 /3 - s) 2 - 4wi (2my 2 p - s) + 4(m) (m - 1)0 £ 0. (61 ) 

Rewriting (61) 

g s 2 g w|4/3 - 2w/3(2 7 4 /3 - 4 7 2 + 2) - 4s(l - 7 2 /3)|. (62) 

With t chosen by (56), 2 7 4 /3 - 4 7 2 + 2 = and 1 - 7 2 /3 > 0, so that 
(62) can only be satisfied if 

s = - ^ 0/(1 - 7 2 0) I Kl&l (63) 

n 

Hence, from (63) and (59) we have 

M(n,d) = - [ *ydV ^ ^^ (Volume of «„). (64) 

Now from (57) 
M = f (yd 2 - r*)dV > [ dV = V n (Vy 2 d* - 1) (65) 

J r<yd/2 J r< V ' 7 2 d 2_ 1 



540 THE BELL SYSTEM TECHNICAL JOURNAL, APRIL 1966 

where V„(r) is the volume of the sphere in Ct„ S(z,r), which is inde- 
pendent of z (due to the symmetry of G„). Thus, (64) becomes 

The asymptotic rate R(0) satisfies 

R(P) = limit - In M(n, V^n) 

(66) 
1 nK(0)(2*)» A . 

„^»n K„(V27 2 /3n — 1) 

Applying the result of Appendix C we have R((5) ^ C (y 2 (l) establishing 
the upper bound. 

4.2 Lower Bound on R(P) 

Again let us consider a maximum size n-dimensional code with mini- 
mum distance d and M(n,d) code words. About each of the code words 
Xi(i = 1, 2, • • • , M) consider the spheres S n (xi,d). We claim that 

M 

the union of these spheres U S„(xi,d) covers the entire space Ct„ . 

This follows from the fact that if x c Ct„ is in no /S„(x,-,rf), then 
d(x , x,) ^ d, i = 1, 2, • • • , M, so that x may be added to the code 
destroying the maximality. If V„(d) is the volume of S n (xt , d) (inde- 
pendent of x,), then 

M-V n (d) ^ volume of a„ = (27r) n . (67) 

Thus, our lower bound is 

M(n4) a g£. (ag) 

The asymptotic rate .R(/3) satisfies 

£(/3) = limit - In M(n, y/2fafi ^ limit - In [ 2 *—, = Rl(P). (69) 
»-- « «-- w 7 n (\/2/3n) 

Again applying the result of Appendix C, we have R (/3) ^ Co(/3) estab- 
lishing the lower bound. 
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APPENDIX A 



Asymptotic Estimates of the Channel Capacity 
The channel capacity C is given by (12) as 

c = _r fMi j_(pi dp + ln 2 A (70 ) 

W Jo p e 

where 

/(p) = 2Ape- M1+ " 2) I (2A P ). (71) 

In this appendix we obtain estimates of C for large and small signal-to- 
noise ratio A. 

A.l Large A: We show here that 

C = i m M + £l (A), (72) 

where e\ (A ) — * as A — » °o . To prove this we will show that for large 
A nearly all the contribution to the integral in (70) is for p in the neigh- 
borhood of unity. Part (i) is an estimate of this contribution. Part 
(ii) shows that the remaining contribution vanishes as A — > ». 
(i) We shall show that if 5 = A~\ 

TU) = - PAp) m ^tfp-^ In ?_ e , (73) 

•'l-a p A 

as A — * go . 

Using the asymptotic formula for Io(.r) for large argument* 

hM - vk V + ° ©] • (74) 

we obtain from (71) (for large A) 

/(p) = j/? p*--^ ' [l + Q)] 1 - * £ p 3 1 + «. (75) 
Substituting into (73) yields (after a change of variable) 

T{A) = [-1 + Qjj [5, + B 2 + flj (76) 

* Ref. 5, p. 86. 
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where 

Bl = £ i/i e~ Ax \l + *)* In j/I e~ Aa;2 dz (76a) 

B 2 = £ i/? e-^U + s) J In (1 + *)* dx (76b) 

5 3 = £ j/3 e- 4l2 (l + x)*0 ^ dr. (76c) 

Noting that the range of integration is — S S x ^ 8 we can write 

Bl = tf x £ i/3 e -^ 2 In j/? r Al2 dx (77a) 

J5 2 = tf 2 £ a/A e ~ Ax2 dx ^ Kz (77b) 

where (1-5)* S #i , K 3 ^ (1 + «)*,| £. | ^ (1+ 5)*ln (1 + $)*and 
5 = 1/il*. From (77b) and (77c) we see immediately that B 2 , B 3 — > 
as A — > oo so that we need consider only Bi . From (77a) (letting y = 
\/2Ax) and setting 5 = A~\ we have 

*-**^C£--"*-fC*'-* (78) 

Since both integrals in (78) and i?i tend to unity as A — ► «>, we have 
B x — > £ In (A/ve) as A — » ». Applying these results to (76) yields 

£s r(4) - 5a (- 1 + ° (a)) ( J '" i + B > + B ) - * ln z 

which is (73 ) . 

(tt) Here we shall show that with 5 = A~ k as in (i) above, 

V (A) = f f{ P ) ln"^ dp -> 0, as A -> ». (79) 

•'pgl-S p 

pgl+6 

To do this we write 

V (A) = f f{p) In M dp + f S /(p) 



./«,. , r^ h & d 



P J a P 

+ 



f /( P ) ln-^dp - C, + fl + C„ 

•M J-J5 o 



(80) 



'1+5 P 
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where a (0 < a < \ ) is arbitrary. We will show that for arbitrary c > 
0, we can choose A sufficiently large so that -q (A ) < c. Let us consider 
each of the integrals C\ , C 2 and C 3 of (80) in turn. 



C\ : For | p ^ a we may write 



^- } ^ 2Ae~ A I (2Aa), 
P 



(81 



since IoOc) is an increasing function of x. Making use of the asymptotic 
formula for h(x) (74) we obtain from (81) 

Ap) 
p 
since a < %. Thus, with A sufficiently large, 



< 



i/i.«"( i+o G)H 



as A — > oo 



' ;1 P 



oor 



and 



C 



■is/ 



2f . £ 

^- 2 pdp = -. 

o or o 



(82; 



C2 : Again using the asymptotic formula for To 0*0 (74) we may write, 
for a ^ p ^ 1 — 8, 



=4/^'( i+o (i))-° - 4 

Thus, with ^4 sufficiently large 

/W ln /W| S a f , 



-/162 



1 + 



&)) 



(83) 



from which 



ft 



^f\^i. 



C3 : As above, we may write for p ^ 1 + 5, 



/(p) 



A _A(p-l)2 
TTp 



(•♦•©)■• 



(84) 



(85) 



Substituting (85) into the denning integral for C 3 (80), and making 
change of variable y = (p — 1 ), we obtain 
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+ /" 4/- (1 + »)' «""•* I" (1 + »)"* * 

' I (86) 

+ j[" 4/^ (1 + yf e~»* In «-"■ <% 

+ f4/J(l + ! /) , e— ln(l + 0g))d». 

Since for y ^ 5, (1 + yf ^ 2e" 2 and | (1 + yf In (1 + y)~ h \ ^ e v \ 
we have from (86 ) 

+ J[" 4/4 ,-««^u^)*i 

Using the well known asymptotic formula for the cumulative error 
function, and the fact that 5 = A -i , it is readily shown that for large A, 



and 

A 1 



jT^.-^t^)**^.^. 



(88b) 



Equations (88a and b) tell us that with A sufficiently large \C 3 \ ^ 
e/3. 

Taking the above results together yields 

h(A)| £ |& I + |C 2 | + |C 3 | ^ c, 

with A sufficiently large. 

(m) The final step is to substitute (73) and (79) into (70) and ob- 
tain 

C . . ire . , 2A , , 4t . . 

- -* ± In — + In — = a In — A, as A ^ °o , 

W A e e 

which is what is to be proved, (72). 
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A. 2 Small A: We show here that 

£ = A(l + 0(A)), (89) 

as A ->0. 

Substituting (71) into (70) yields, after a bit of straightforward 
manipulation, 

£ - A - 1 + 2AV / pV" 4p2 I (2pA)dp 

W ->o 

(90) 
- 2.4 e~ J / pe"- 4p2 7o(2pA)ln/ (2p/l)(/p. 

•'o 

If we change the variable of integration to x = 2pA, we obtain from 
(90) 



W = A -+o-j- 2 / xh(x)e dx 



-, r (91) 

6 — / a;/o(x)e~ l2/0 In I (x)dx. 

ZA Jo 



Now the first integral of (90) is known and is 

f x 3 h(x)e~ z2liA dx = 8A 2 (1 + A)e\ (92) 

so that 

£ - 2A - £ [ xh{x)e~ x "- IAA In I (x)dx = 2A - tL D. (93) 
W 2A Jo 2A 

We can estimate the integral D for small A, by noting that most of the 
contribution is for small x. Making use of the asymptotic formula for 
Ia(-v), for small x 



h(x) = 1 + J + 0(.t 4 ), (94) 

we have 

D = | pi + 0(z 5 )~Lr l2/4x dr. (95) 



* Ref. 6, p. 198, (4a). 
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Since 



and 



we have 



r x. e -z>,*A dx = 2A 2 

Jo 4 
f° x b e-* i,AA dx - 64A 3 r(3) = 0(A 3 ), 



D = 2A 2 (1 + 0(A)). (96) 

From (96) and (93) we get 

£ = 2A - Ae- A (l + 0(A)) = A(l + 0(A)) 
W 

which is what was to be proved (89 ) . 

APPENDIX B 

The Function X (£) 

In this appendix, we show that for £ satisfying 

< * S 1, (97) 

there exists a unique X(£) which satisfies 

t = l- *<*<*» . (98) 

* Jo(A(*)) ' 

If we define the function £ (X) by 

f00 = l-r7^> 0gX<oo, (99) 

it will suffice to show that 

(i) £(X) is strictly monotone decreasing, 

(it) £(0) = 1, 

(Hi) lim £(X) = 0. 
x-»» 

If (i), (m), and (Hi) are true, £(X) is a one-to-one mapping of the half 
line [0, oo ) onto the interval (0,1]. 
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(i) Making use of the fact that Jo (X) = Ji(X) we can write 
#(X) __ -/o(X)/i'(X) + /i 2 (X) 



Since 



we have 



and 



d\ (/o(X)) 2 

/o(X) = - /"V-'dft 

IT JO 

h(\) = /o'(X) = - [' cos < pe Xcoav d*p, 

IT J 

j/(X) = - ( W coa 2 <pe XooBp <b. 

TV *Q 



(100) 



Thus (100) becomes 

g(X) 

r/X 



(101) 



' / X COS <P I I 2 X COS villi X COS « i 

— — / e </<? / cos ^e a<p + — ( / cos <pe dip 

= IT* JO Jo 7T Z \Jq 

[MX)] 2 
By the Schwarz inequality 

(f* cos ^ °°' '<b) <(f* cos 2 <pe x coa * <b)(f e x cos v Ap\ , 

(the strict inequality holding). Hence , x < and (i) follows. 

aX 

(Hi) We make use of the asymptotic formula for h(x) and Ii(x) 
for large x\ 

V2 "[ 8x ;:: iw 

V 2ir.r L 8.c V / J 

Substitution of (102) into (99) yields (Hi) immediately. 

* Ref. 4, p. 76. 
t Ref. 4, p. 86. 
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Let us remark here that since h(x) and h{x) are even functions of x, 
if x (£) = a ^ is the unique nonnegative solution to (98), then X (£ ) = 
— a is the unique nonpositive solution to (98). 

appendix c 

Completion of Asymptotic Estimates of R((J) 

We have denned V„(r) as the volume of the sphere S n (z,r) = {x e 
a n : d (x,z) < r\ . Due to the symmetry of GL n ,V„(r) is independent of 
z. Thus, we shall take V„ (r) as the volume of 

S(0,r) =|x= U,.t 2) --- ,x n )ea n : d 2 (0,x) = g (2 sin |J < r 1 } . 

In this appendix, we evaluate 

lim 1 . (27r) n . ,,.„> 

w ^-ln T , , /— v ^-g a . (103) 

n Vni'van) 

We shall find E a by solving an equivalent probability problem: Let 
Xi , Xt , • • • be a sequence of independent random variables uniformly 
distributed on the interval [— t,it]. Let 



r-SC 9 "»*)'• 



It is clear that 



hence, 



.21 F.(f) 



Pr[r„<r 2 ] = ^, (104) 



-lim(l/n) In Pr[F„ < an] = #„ . (105) 

n-*» 

We now make use of 

Chernoff's Theorem: 7 Let Z\ , Z 2 , • • • be a sequence of independent identi- 
cally distributed random variables with moment generating function E[e Zk '] 
= M(t).Let 

Pn = Pr |g Zi ^an\, 

where a ^ E(Z,). Then 

„-.oo - In P n = In m, 
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where m = min e~ at M(t). 
If we set 

Z* = [2sin^], 

where X k is the above random variable, then 

Y n = £z t . 

Thus, from (105) and Chernoff's Theorem, E a = —In m. 
The moment generating function of Z* is 

M(l) = E[e Zkt ] =y\_ ' ex P {( 2 sin |Y *} dT 

i r T " " (106) 

1 / (2 (-2 (coax) j 2t T / ,\ 

= rr- I e dx = e Io(2t). 



Hence, 

m = mine (2 ~ B) '7o(20. (107) 

To find the minimum, set the derivative of (107 ) equal to zero : 

= e (2 ~ a) '[(2 - a)J„(20 + 2Ji(2<)], 
so that the t which minimizes (107) satisfies 

The solution to (108), for t g 0, is 2t = -A (a/2), where \(£) is defined 
by (12). (See the remark at the conclusion of Appendix B.) Hence, 
from (107) 

(109) 





m = exp 


[-(■■ 


-i>m-«i»- 




so that 












E a = —In to 


= -In 7 


.(»©)+(■> 


s 




■«© 









(no) 



where C (£) is defined by (1G). 
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Applying (110) to (66) yields R a (fi) = C o (y0), and applying (110) 
to (69) yields R L (p) = C (/3). 

APPENDIX D 

Exponential Error Bounds 

It is known that for any time-discrete (amplitude continuous) 
memoryless channel the smallest attainable error probability P e (n,R) 

A 

for an n-dimensional code with e nK code words may be written 

P*{n,R) = exp [-?iE(R) + o(n)], (111) 

where E(R) > when R < C (the channel capacity in nats per symbol) . 
Although E (ft,) is not always known exactly it can be estimated by 
upper and lower bounds. The best known lower bound on E(R) is 
given in Gallager (Ref. 8, Theorem 10) and the best known upper bound 
on E(R) by Shannon, Gallager, and Berlekamp. 9 

Let P(y | x) be the channel transition probability density. We assume 
that any n-sequence of input symbols is an allowable channel input 
— i.e., no "input constraint". The bounds of Refs. 8 and 9 can then be 
stated as follows: 

For any p ^ and input probability density /(.r), let us define 

E(p,f) = E ( P ,f(x)) - pRo( P ,f(x)), (112) 



where 



and 



E ( P ,f(x)) = -In / dy[f g dxf(x)P(y\x) in+ '~\ (112a) 



d 



Ro(pJ(x)) =f E (p,f(x)). (H2b) 

dp 

With p ^ specified let/ p (.r) be that input density which maximizes 
E(p.f(x)). It is shown in Ref. 8 that with p fixed f p (x) is the unique 
density which satisfies 

fidyP(y\x) m+ W(y)^ [ a p (y) 1+p dy, all re, (113) 

with equality if fp(x) ^ (all x) where 

«,(V) = [ f,(x)P(y\x) m+ 'dx. (H3a) 
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It can be shown that with p = 0, fo(x) is that input density which 
achieves capacity C, and R (OJo) = C. In most channels of interest 
R (p,f p ) decreases from C to as p increases from to oo . 
We define the rate R parametrically in terms of p by 

R = R( p ) = R (p,f p (x)). (114) 

Then for ^ p ^ 1, which corresponds to R„(l,fi(x)) ^ R ^ C, the 
exponent is known exactly : 

E(R) = E(p,f p ) = E (p,f p ) - P R (115) 

where E, Eo , and f p are defined by (112). For p ^ 1, which corresponds 
to R ^ R (l,fi), the ("sphere-packing"), upper bound on E(R) is 

E(R) ^ E (p,f P ), (116) 

and the ("random-coding") lower bound is for ^ R ^ R„(l,fi) 

E(R) ^ Eo(lJi) - R. (117) 

This estimate of E(R) may be unproved for low rates R. It is shown 
in Ref. 9 that if E* (R) is an upper bound on E (R) which is sharper than 
the sphere-packing bound (116) for low rates R (such a bound can al- 
ways be found), and if E (R) and the sphere-packing bound are plotted 
versus R, then their common tangent is also an upper bound on E(R). 
The lower bound may be sharpened for low rates R as follows. For 
p §£ 1, and input density g(x), define 

E x ( P ,g) = E 0l (p,g) - pRo*(p,g), (118) 

where 

E 0x (p,g) 

Vi" (118a) 



-P In jf g(x)dx f x g(x)dx' fjT P(y | x^Piy \ x) h dy\ 



and 



Ro*( P ,g) = ^E 0x (p,g). (118b) 

dp 



Then for any fixed g(x) and with R again given parametrically in terms 
of pby 

R = R 0z (p,g), (119) 
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the ("expurgated") lower bound is 

E(R) ^ E,(p,g). (120) 

We shall now apply these results to our channel using the time-dis- 
crete model denned before and after (26). Here the input is a number 
X e [— tt.tt], and the output is a pair of real numbers (Yi , Y 2 ). If X = 
x is the input, then the conditional transition probability density is the 
two-dimensional 

P(yi ,2/2 1 a;) 

= _L exp {-[( yi - V2S cos xf + (7/2 - \/2S sin x) 2 )/2N] 

JiirlS 

or in polar coordinates 

P(r,<p I x) = rP(r cos <p, r sin <p \ x) 

("" r y cos (* "■*))• 

It may be verified by substitution into (113), that the input density 
f( x ) = 1/2-ir maximizes E(p,f(x)) for all p ^ 0. Further a direct sub- 
stitution of (121) into (112a) yields after a straightforward computa- 
tion 

Eo( P ,f P ) = -In 2Ae~ A £ ve~ Av2 [/<> (i^)J ' ^ ( 122 > 

where A = S/N, the signal-to-noise ratio. The rate, R, can be gotten by 
differentiating (122) with respect to p. This yields 

R( P ) = ~ E Q (p,f p ) 
dp 



r - SIK _ rV2N , _V2S'^, „^^ (121) 
2^N e e GXP 









After some manipulation one can show that R(p) | p =o = C, the channel 
capacity as given by (12). The estimate of the exponent E(R) of (115), 
(116), and (117) is plotted versus R in Fig. 7 for signal-to-noise ratio 
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Fig. 7 — Upper and lower bounds on the error exponent # (#) vs. R for signal- 
to-noise ratios of (a) A = 2, (b) A = 20. (Curve A is the exponent E (R) in the 
range where it is known exactly (115). Curve B is the "sphere-packing" upper 
bound on E (R) (116). _ Curve C is the "random coding" lower bound on E (R) 
(117). Curve D is E* (R), the low rate upper bound (133). Curve E is the common 
tangent to E* (R) and the sphere-packing bound. E (R) lies in the shaded region. 

A = 2,20. The sphere-packing upper bound and the random-coding 
lower bound diverge for small rates R. We shall improve this situation 
by computing the low-rate expurgated lower bound on E(R) (120). 
If we again choose the input density to be g(x) = \/2v, —ir^x^ ir 
we have from (121 ) 
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/ P(y | x) h P(y | xVdy = jf dr Jj^ exp (-S/N. - r 2 /2N) 

L exp ( ~ w v 2 ^ cos ^ "~ ^ "*" cos ^ ~~ *'^/ ^ 

= f" dr At ex P (S/N - r 2 /2N) 
• / exp f — -==- Br cos (<p — a)\ d<p 

_ exp (-fl/y) jf" r exp ( _ rV2JV)/o (v* Br ) dr , 

where 

„ / ; 7T i , -i Tsin x + sin x "I 

5 = VI + cos (a; — z') and a = tan ■ . 

|_cos # + cos x J 

This integral is tabulated [Ref. G, p. 198, # 5] so that we have 

f P(y\x)*P{y\x)*dy = exp (-(S/2N)[1 - cos (x - x')]). (124) 
Substituting (124) into (118a) yields 

EoAp,9)= -P^f^ZLt 

•exp [-S/2Np - (S/2N P ) cos (x - x)\ 

(125) 

' =-^£^ exp( - s/2WIo (2r P ) 

= -p In [exp (-A/2 P )h(A/2p)}, (p ^ 1) 
where A = £/iV. The rate R is given parametrically in terms of p by 

^ £, , <9# x / , A h{A/2p) , r / 4 /9 \ 
ft = /2(p) = — — (p,g) = s- - In h(A/2 P ) 

dp 2pIo{A/2 P ) (126) 

(p£ 1). 

Let us note that as p — » <*> ft(p) — » 0. The expurgated bound is given 
by (120), (125), and (126). It is easy to show that as p — > », (ft — > 0) 
the lower bound E x (p,g) — » A/2. 

We shall now obtain a sharper upper bound for low rates E* (R) 
which will in fact have E*(0) = A/2, establishing that E(0) = A/2. 
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Let us denote by p„(M), the smallest maximum (normalized) correla- 
tion obtainable for an n-dimensional polyphase code with M code words. 
Paralleling arguments of Shannon (Ref. 10, pp. 647-648) it is not hard 
to show that the error probability for a code with M = exp (nR) code 
words satisfies 

P e ^ §P r [error in a code with two code words with energy ST 
and correlation p„(M/2) in white Gaussian noise with 
spectral density N ]. 

The right member of this inequality is known [Ref. 11, (38)], and is 
equal to 

KVfO-d)))- 



where 



* ix) = v^L e ~ u2,2du 

is the cumulative error function. 

We now bound E(R) by finding a bound on p„(M/2). Since for large 
M, a code with M/2 code words has about the same rate as one with M 
code words, it will suffice to bound p„(M). With M = exp (nR) and 
n large, we have from (17) (since /3 = (1 — p)) 

R ^ Co(l - VpJM)). (128) 

If we define R parametrically by 

R = R( ff ) = Co(cr), ^ <r £ 1, (129) 

we have from (129) 

a ^ 1 - VpJM) (130) 

or 

[1 - Rn(M)] ^ a (2 -a). (131) 

Substituting (131) into (127) yields 

Making use of the well-known asymptotic formula for the cumulative 
error function $(— .r) ^ (l/\/2irx) exp ( — x 2 /2) (large x), we obtain 
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from (132) for large T (and therefore large n = WT), the upper bound 
on the error exponent 

E(B) = - lim i In P e g ^ *( 2 - *) - E*(R) (133) 

where A = S/tf.lF = S/N. When 72 = 0, a = 1, so that E(0) = A/2. 
The expurgated bound and the bound of (133) are plotted in Fig. 7. 
The upper bound is, of course, sharpened by drawing the common tan- 
gent of E*(R) and the sphere-packing bound. 

APPENDIX E 

Asymptotic Estimates of C (£) 

In this appendix we obtain estimates of Ca(£) as £ — > and £ — > 1. 
E.l Small £: We show here that 

Co(£) = *ln^+ fl (£) (134) 

e£ 

where £i (£) — » as £ — > <*> . 

From proposition (Hi) in Appendix C, we know that as £ — > 0, 
\(£) — » oo. Again making use of the asymptotic formula for h(x) and 
Ii(x) for large x (102), we obtain by substitution into (15), 



-* 



1 + 



•©: 



135) 



or 



X = ^ + 0(1) = 4 + & + *<*)> (136) 

where t(£) — > as £ — » and k is a constant. Substitution of (136) into 
(16), and another application of the asymptotic formula for Io(x) yields 
(134). 

E.2 Large £: We show here that 

<?o(£) = (1 -£) 2 {1 + 0[(1 -£) 2 ]} (137) 

as £ —» 1. As above our first task is to estimate X (£) when £ is near unity 
or X(£) is near zero. We need the asymptotic formulas for Io(x) and 
h(x) for x near zero (Ref. 4, p. 77) : 
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/o(s) = 1 + | + 0(.r 4 ), 
h(x) = \ + ^ + 0(.r 5 ). 



(138) 



Substituting (138) into (15) yields 



i = 1 -m = l --2 + 0{xZ) - (139) 



Setting | = 1 — £ we have, 

| = ^+0(X 3 ). (140) 

We show that 

X = 2| + 0(f) - 2(1 - g) +0((1 - £) 3 ). (141) 

Equation (141) follows on setting x = \ — 2£ and observing [from 
(140)] that 

x O(X') . k 



^ [| + 0(X) 3 J 

as X — ► or £ — ► (£ — * 1 ). Substitution of (141 ) into (1G) and another 
application of the asymptotic formula for h(x), yields (137). 

APPENDIX F 

Comparison of Modulation Schemes 

in this appendix, we shall describe an amplitude modulation scheme 
and compare its performance with that of the phase modulation scheme 
studied in this paper. 

Referring to (21a) we see that our phase modulated signal may be 
written (during the At h subinterval) 

Si(l) = x ik W -sin eQwWt + xh™ cos a2 v Wt, (142) 

where from (21b) 

[.r lt (,) ] 2 + [.r,/ 2) ] 2 = aS, fe = 1, 2 , • • • , n. (143) 

Consider an amplitude modulation (AM) scheme in which the signals 
Si(t) are given by (142) but with (143) replaced by the "mean square" 
constraint 
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E \l*» m T + [*■]■) ^ 2Sn = 2WST - 



(144) 



fc-1 



The resulting signals *<(<) are then amplitude modulated signals with 
carrier frequency <x2tW radians per second and average power 

1 [' Si \t)dt = ±± I"* Si \t)dt * S. (145) 

Thus, in this case the signals are constrained to have average power not 
exceeding S. It is clear that, as for the phase modulation, the signals of 
the ath and /3th users of the channel are orthogonal so that we may again 
take the bandwidth (i.e., difference in carrier frequencies of adjacent 
users) to be W cps. Further, it follows from the analysis in Section III 
that this channel is mathematically equivalent to the time-discrete 
channel Gaussian channel considered by Shannon. 10 ' 12 This channel 
accepts real numbers at a rate of 2W per second and adds to each num- 
ber an independent Gaussian variate with mean zero and variance N W. 
Messages are encoded in blocks (vectors) of 2WT real numbers (which 
take T seconds to transmit), each 2WT -vector having the sum of the 
squares of the coordinates not exceeding 2WST. Shannon has found the 
capacity of this channel to be (in nats per second) 



W In 1 + 



S 



N a W 



= Wh.{l + A 



146) 



where A = S/N W, the signal to noise ratio. Equation (146) is plotted 
in Fig. 2 so that it may be compared to the capacity of the polyphase 
system. Note that for small A, In (1 + A) « A so that from (14) the 
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Fig. 8 — Lower bound on the exponents E a (R) (curve A) and E P (R) curve B). C P 
and C a are the capacities of the polyphase and AM systems, respectively. The 
signal-to-noise ratio A = 2. 
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capacities of this AM scheme and the polyphase scheme are nearly the 
same. 

Further, letting P ep *(T,R) and P ea *{T,R) be the smallest attainable 
error probability for a code with parameter T and rate R nats per sec. for 
the polyphase and AM systems, respectively, we can write 

P ep *= exp[-TE p (R) +0(T)] 

Pea* = ex V [-TE„(R) +0(T)]. 

The exponent E P (R) is estimated in Appendix D and may be written 

E P {R) = WE(R/W), 

where E(R) is defined by (111). The exponent E a (R) is estimated in 
Refs. 10, 8, 9, 13. The exponents are compared in Fig. 8 for A = 2 by 
plotting their known lower bounds. It is also possible to show that 
E„(0) = E p (0) = AW/2 for all A. 
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